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FIGURE 11 Four-state electronic random number generator used 


in this experiment. An incorrect choice of target 
is indicated. Two of the five “encouragement lights” 


at the top of the machine are illuminated. The 


printer to the right of the machine records data on 


fan-fold paper tape. 
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Four-State Electronic Random Number Generator 


This study provided an opportunity to determine whether the re- 
mote sensing capability could be extended to the perception of the 
internal state of a piece of electronic equipment. For this purpose, 
an automated experiment designed around a four-state electronic random 
number generator was initiated. The solid-state eacnade has no moving 
parts and provides no sensory ag to the user as to its target genera~ F 
tion. 
In order to determine unambiguously whether a result was meaning- 
ful, the oa toate Sees was used. First, the randomness of the 
machine was verified by over 10,000 pre-experiment trials (details 
given below). accetas the subjects interacted with the machine to 
generate the datas. Third, for any subject whose score was Henipicaits 
the statistics of the machine during the successful experiment were 
tabulated to insure that the machine had not departed from randomness 
in the period in which a significant result was obtained. Fourth, a 
‘subject generating a good score was asked to ecias the entire experi- 
ment after a one-month ie period. Finally, the entire data analysis 
was carried out by an independent statistics group at SRI. Cor. Riehand Lenylotir), 
The machine configuration provides as a target one of four art 
slides chosen randomly ae 1/4) by an electronic random generator. 


The generator does not indicate its choice until the subject indicates 


his choice to the machine by pressing a button (see Figure 11). (The 


Approved For Release 2003/04/18 : CIA-RDP96-00787R000200150009-7 


bre 


Approved For Release 2003/04/18 : CIA-RDP96-00787R000200150009-7 
machine has four stable internal states. A 1.0~MHz square-wave 


oscillator sends pulses to an electronic "scale-of-four' counter which 
passes through each of its four states 250,000 tiimes per second. The 
state of the counter is determines. by the length of time the oscillator 
has run, that is, the time between subject choices.) As soon as the 
subject indicates Sie nee: the target slide is illuminated to provide 
visual and auditory (bell if correct) feedback as to the correctness 
’ 

or incorrectness of his choice. Until that time, both subject and 
experimenter remain ignorant of the machine's choice, so the experiment 
is of the double-blind type. Five legends at the top of the machine 
face are itnaaeeg one at a time with increasing correct choices (6, 
8, 10, .-.) to provide additional reinforcement. The machine choice, 
“subject choice, cumulative trial number, and cumulative hit Sonbes are 
recorded dutomaticalay on a printer. Following trial number 25, the 
meenine must be reset manually by depressing a RESET button. 

'A methodological feature of che machine is that the choice of a 
target is not forced. That is, a subject may press a PASS button when 
he wishes not to guess, in which case the machine indicates what its 
choice was. The ventas thus scores neither a hit nor a trial and then 

“ goes on to make its next selection. Thus, the subject does not have to 
guess at targets when he does not feel that he has an idea as to which 


to choose. 
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Under the null hypothesis of random binomial choices with probability 


1/4 and no learning, the probability of observing >k successes in n trials 


is approximated by the probability of a normal distribution value, 


2 (« i - 2 ay! 3n/16 


Pre-Experiment Randomness Tests 

‘The design objective was to puild a four-state machine, with each 
state equally likely to occur on each trial, independent of the past 
sequence of Pecan. te the machine meets this objective, it should not 
be possible to devise a rule for future play that significantly differs 
ei chance. A simple example of such a sue would be to select the 
machine state observed in the preceding frie lt if this strategy were 
to produce scores significantly above chance (25 percent hits), we 
would reject the ioneenesis of randomness of the machine under test. 

Before experimentation machines purchased from Agiawids Electronics, 
Albion, California, were extensively tested for randomness. pata were 
analyzed on a CDC-6400 computer, and the machine finally selected for 
use met established criteria for randomness. 

In developing randomness tests, we are guided in part by a knowledge 
of the machine logic. When ene of the four choice keys se the pass key 
is depressed, the current machine state is displayed; then a brief time 
after velease of the key, a new machine state is established (but not 


ghown to the subject) by sampling the instantaneous state of a high- 
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speed four-state electronic counter. For the machine to be randon, 


the times of dwell of the counter in. each of the four states must be 

‘precisely equal; otherwise, the distribution of outcomes will be biased. 

The first rendombas test is thus based on tallying the number of 

occurrences of each of the four states. This test should detect a 

stable bias, yet may miss a drifting bias. To test for this second 

possibility we also tally the distribution of outcomes in each group 

of 100 trials, then compute a likelihood ratio test statistic (see 

below) for each group. Under the null hypothesis of equal likelihood 

of the four states. these statistic values are distributed approxi- 

mately as chi-square with three degrees of eeeadon and their sum for 

m groups vieGeinaced approximately ae chi-square with three m degrees 

of freedom. This test may also detect stable bias, but is not ns 

powertul for eae wuepode as the first coke: Variable bias of still 

a shorter period, if substantial, can be tested for by tallying the 

frequency with which the previous machine state is repeated; an overall 

repeat ratio ("all") significantly above 0,25 is indicative of such bias, 
If for any reason the machine were to fail to sample the counter 

to establish a new state, the previous machine state would be repeated. 

To test for this possibility, we tally the number of repeats following 


the depression of each key. A repeat ratio significantly greater than 


0.25 should be considered a danger signal. 
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We also tally the initial machine states following reset and the 


transitions between states. In each case, the number of occurrences of 
each of the four possible outcomes should be sae ieeaY equal, When 
fepente are deleted from the eeeheuse of trials ("nondiagonal transi- 
tions"), the four states should also be approximately equal in frequency. 


In testing the null hypothesis of four equally likely outcomes of 


a trial, a likelihood ratio test is used. The statistic 


under the null hypothesis is distributed eee as chi-square 
with three degrees of freedom, with rejection for large values of this 
statistic.* The computer program used in bce randomness includes 
a subroutine for Boapatene the probability of a chi-square value as 
large or larger than that observed. 

In teating the null hypothesis that the Le eunalets of a. repeat 
is 0.25, the binomial eatcniee of sbtatnine the observed ee 
or more repeats in N trials is Saas For K greater than 1000, a 


normal distribution approximation is computed, assuming the statistic 


K- 1/2 [x 
( N - 0.28) 3/16 


to be approximately normal with mean zero and standard deviation one. » 


ee re ee ee TY I ES 


*Alexander Mood, Introduction to the Theory of Statistics (McGraw Hill, 
New York, 1950). 
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The typical test pattern used was six passes followed by 25 choices 
of one color, repeating this for each of the four colors. In this way 
each of the five keys other than resetwere given rrr ee equal 
use. Typically, 2000 to 6000 trials were made in each sitting. In the 
absence of any unusual results in the randomness tests, a minimum of 
10,000 trials were made peices using a machine with experimental subjects. 
With 10,000 trials, the expected fraction of repeats is 0.25 with a 
standard deviation of 3/200 = 0.00866. 


A computer listing of the results of randomness tests is included 


in Table l. No significant departures from randomness were. observed. 


Subject Data 

Data was collected from subjects Sl through 56. Each subject was 
asked to soapicte 100 25-trial runs (i.e., a ieee of 2500 trials each). 
The results are tabulated in Table 2. (One subject, 53, declined to 
complete the 2500-trial run, indicating a lack of rapport with the 
machine and, hence, a ioe we motivation for the task.) For the six 
subjects, only one es scored significantly above chances: For the 
2500 trials that eaugacs averaged 29.36 hits/100 trials rather than the 
expected 25/100, a result whose a priori probability under the null 
hypothesis is p = 3x10, His scores are plotted in Figure 12. 

The statistics of the machine during the successful run of subject 


$2 were tabulated for the entire 3488 machine transitions (2500 choices, 
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Table 1 


PRE-EXPERIMENT RANDOMNESS TESTS * 


ecg ae RY OCC Sl I O88 OT CLO LO TLL DE OSES ee re ne ee re ae Te a Se Se 


Buttons : Number 


SS Se f Chi-Sq. 
Yellow | Green | Blue = Te 


ania 


means mee fun me oreo nee oe fear nec ee 


Initial states 107 116 113 464 1.996 


Transitions Y 728 764 765 3047 2.573 
ao G 777 784 773 3197 6.745 
Prony B 776 796 810 3155 1,158 ° 
R 787 852 803 3247 2.877 
All states 3175 | 3312 | 3264 13110 5.667 
Nondiagonal 
transitions 2340 2412 2341 9519 2.630 
Diagonal 
transitions 728 784 810 3127 5.414 
eae a meee ; Bionomial 
Key N-Trials Repeats Ratio 
i eerie Enron as wa SE BODs - 
Diagonal Yellow |. 2774 705 0.2541 
transitions 
0.2446 


as a function Green — 2755 674 
of key press 


Blue 2761 706 0.2557 
Red | 2742 667 0.2433 
Pass 1614 375 ere 
All 12646 3127 0.2473 


ee a a ar ee nt —— 


ne ee LL A SE GOT 


Randomness in groups of 100 trials: 


Chi-sq. = 299.6141 _ D.F. = 345 Prob. = 0.9628 


ce ee ee ne 


eg LE OE 
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TABLE 2 


FOUR-STATE ELECTRONIC RANDOM NUMBER GENERATOR 


MEAN SCORE/100 TRIALS BINOMIAL 
SUBJECT OVER 2500 TRIALS PROBABILITY 
Sl 25.76 0.22 
S2 29.36 . 3x 10° 
$3 24.67 (750 trials) 0.60 
S4 25.76 0.22 
85 °25.20 - 0.42 
S6 25.40 0.33 
-4 
87 27.88 4.8 x 10 
(replication) 
, oY me) 
All trials 26.47 1.1 x 10 


(15750 trials) 


Ee nh Sits 
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TABLE 3 


7 MID-EXPERIMENT RANDOMNESS TESTS 


. BUTTONS ; Number 
of 


Binon. 
Prob. 


Chi~Sq. 


Initia] States 70.80 


Transitions 70.80 

To '>0.30 

70.70 

>0.80 

‘JA11 States 70.50 
Nondiagonal y 

Transitions >0.50 

Diagonal 
Transitions >0.70 
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RUN NUMBER - 100 Trials/Run 


p= } per trial 


FIGURE 12 DATA SUMMARY FOR SUBJECT 2 
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